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ABSTRACT 

A dynamic game theoretic model of concordance of interests in the process of social partnership in 
the system of continuing professional education is proposed. Non-cooperative, cooperative, and 
hierarchical setups are examined. Analytical solution for a linear state version of the model is 
provided. Nash equilibrium algorithms (for non-cooperative and cooperative setups) are identified. 
H.Stakelberg'sIt algorithms of equilibrium solution of the game in hierarchical setup are described (in 
the general case). A method of building the precise discrete analogue of a continuous model is used 
for examining the hierarchical setup. Examples of test calculations for different data sets are 
provided; content interpretation of the results is discussed. 
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Introduction 

Social partnership in continuing education is a specific system of joint activities 
of the education system agents characterized by trust, common objectives and 
values; it provides highly qualified, competitive, and mobile specialists for the 
labor market (Tarasenko, 2009) Many authors studied the social partnership in 
education (Tarasenko, 2009; Keith, 2011; Siegel, 2010), but only a few papers are 
dedicated to modeling of this process (Siegel, 2010; Fandel et al., 2012; Talman 
and Yang, 2011). The first author contributions are presented in the following 
works (Zaharatul et al., 2012; Dyachenko et al., 2014). 

In contrast to (Zaharatul et al., 2012; Dyachenko et al., 2014), in this paper 
the authors consider a differential game model with payoff functionals reflecting 
the concordance of private and public interests in resource allocation. This 
problem setup is initiated by a seminal paper by Yu. B. Germeier and I. A. Vatel 
(Dyachenko et al., 2015) who have shown that under a specific structure of payoff 
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functions the Pareto optimal Nash equilibrium of the static game in normal form 
exists, i.e. the complete concordance of the players' interests is achieved. Close 
setups were also considered in static models of the active systems theory 
(Germeier and Vatel, 1975) and in the information theory of hierarchical systems 
(Burkov and Opoitsev, 1974). Later on the problem of concordance of interests was 
actively developed in network games. In particular, Ch. Papadimitriou has 
introduced a notion of price of anarchy as a quantitative characteristic of the level 
of concordance of private and public interests (Gorelov and Kononenko, 2015). 
This idea was developed by Basar and Zhu in the dynamic case (Basar and Zhu, 
2011). Dynamic counterparts of the models are reviewed in (Basar and Zhu, 2011). 

In some specific cases using theoretical game model in continuous time allows 
to find the analytical solution. In general case, the author's method based on 
building the precise discrete analogue of a continuous model (Long, 2010) is used 
for finding the solution of a differential game. 

The paper is organized as follows. In Section 1 a mathematical setup of the 
problem of concordance of interests in social partnership in the system of 
continuous professional education (CPE) is presented. The model linear state 
version analytical examination (Ugol’nitskii and Usov, 2013) is described in 
Section 2. The method of solution of the general differential game model of 
concordance of interests by digitization is proposed in Section 3. Test examples of 
numerical calculations are analyzed in Section 4. The obtained results are 
discussed in Conclusion. 

1.1. Mathematical setup of the problem 

A social partnership between three control agents: a university teacher (B), 
an employer (P), and a student (C) is considered. First, it is assumed that the 
agents are independent and make decisions independently and simultaneously. 

All control agents aim for maximizing their payoffs discounted at time period T . 
The differential game model has the following form: 

T 

= jV ~ p ' [g,. (r t - Uj (0) + L + e pT s t (T)c(x(T)) -» max, 

0 

( 1 . 1 ) 

0 < Uj (t) <Tj, i gN", 

( 1 . 2 ) 

X = h(x(t)) + f(u B (t),u p (t),u c (t)), x(0) = x 0 

(1.3) 

In the model of concordance of interests it is assumed that each player 1 

from set ^ ~ ^allocates his budget between two directions: share u >^ 

(the player's control) is allotted for the students' professional level improvement, 

whereas the rest 1 ' v J is used for financing his private activities (business 

development, stocks and deposits, or consumption). Respectively, a current payoff 
of a player is formed by private revenues and utility from the level of professional 
training of the students (public good). 


(5£) INTERNATIONAL JOURNAL OF ENVIRONMENTAL a SCIENCE EDUCATION 


13057 


Q . (V) 

Thus, in the model (1.1) - (1.3) ' is a concave increasing function of the 

variable z, reflecting private revenues of the players; w is a level of professional 

c(x) 

training of the students (a state variable); v ' is a concave increasing function 
showing a financial expression of the public utility from the level of professional 

training; is a share of the i -th player in this public good; b is a decreasing 
function, i.e. in the absence of investments the level of professional training 

diminishes; f is an increasing function of players' investments in the 
professional training of the students. 

1.2. Analytical study of the linear state model 

For analytical tractability let us consider a linear state simplified version 
(Dockner et al., 2000) of the model (1.1)- (1.3) in the following form 

T 

Jj = J e~ pt [k j {r t - u t (t)) p ‘ + s, ( t)cx{t)\dt + e~ pT s i (T)cx(T) —» max, 

o 

( 2 . 1 ) 

0 <«,.(?) < r n i e N\ 

( 2 . 2 ) 

x = ax{t) + ^ ]b i u j (0, a:(0) = x 0 

isN 

(2.3) 

Hence, in (2.1) - (2.3) in comparison with (1.1) - (1.3) model, a linear function 

c(x(t)) — exit) , w j iere c > 0 j s a coefficient of transition from a level of 

professional training to the public utility, and a linear function 

(x(t)) ax(t ), a < 0, are use( j j n what follows, a linear function 

f(u B (t),u P (t),u c (t)) = Y J b i u i (t) 

isN , where ' is a share of the ; th player 

contribution to the upgrading of the students' professional training level, is used 
for simplicity. Finally, without essential loss of generality a power function of 
private revenues is taken: 

g t (r { - u t (0) = k j (r ; - u t (t)) Pi ,k t > 0, 0 < p { <l,(EiV 

For solution of the game (2.1) - (2.3) Pontryagin's maximum principle is 
applicable. The i-th player's Hamiltonian function is as follows: 

H i (u i (t),A i (t),x(t),t) = k i (r i -u i (t)) Pi +cs i (t)x(t) + A i (t)[ax(t) + Y J b j u j (t )] 

jeN 


From the condition ® with regard to non-negativity of U '^ 

following can be determined: 


the 
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dO 


NE/.\ 

Ui (0 = 1 


r. - 


0, 


^,2,.(0V-> 


kp, 


i J 


b, 

Z,(t)>^rr\ 


(2.4) 


A boundary value problem for the conjugate variable is 

^ = (p-aWO-csM MT ) = c S/ (T) 
at 

(2.5) 

its solution 


r(t) 


— < ,(p- a )d- 7 ’) 


c5,.(r)+e 


(p-a)(t-T) 


1 

\c Si {T)e (p - aXT - r) dT 


( 2 . 6 ) 

Due to the properties of the model (2.1) - (2.3) the relations (2.4) with regard 

NE / \ / NE / \ NE / \ NE / \\ 

to (2.6) actually form the Nash equilibrium V b w? p w? c w/ in this 

model. It is known (Ugol’nitskii and Usov, 2013) that in the linear state 
differential games open-loop and closed-loop (Markovian) Nash equilibria 
coincide. The respective equilibrium path is 


/ 

'(0 = x 0 e at + J< 


t a(t— t) 


Y.biU^ir) dr 


(2.7) 


The obtained analytical solution allows for some qualitative conclusions 
about the social partnership in the framework of the model (2.1) - (2.3). Hence, the 

condition ^ — k 'Pt r i ^, c h arac tenzes a "pure egoism" of the ! th player due 
to which the whole budget is assigned only to his private activities. Note that a 

"pure collectivism" v ' v J 1 , when all investments are allocated for professional 
training and, therefore, for social partnership development in the continuing 
professional training system, is not attained in the equilibrium strategy (2.4) if 
k , » 0 

From the equilibrium path form (2.7) it is clear that high level of professional 
training can hardly be sustained under the linear dynamics of the state because 

the first summand in (2.7) decreases exponentially (^ ^ Q) _ 

Now consider a cooperative setup of the social partnership control problem 
when all agents unite and jointly maximize the summary payoff functional 

T 

J = y,./, = J e~ p, \5'k j (j'i - u i {t)) p ‘ + cx(t)\dt + e pT cx(T) 

i&N o 

( 2 . 8 ) 
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Vf£s ( .(f) = l 

(s. t. ieN ) in all controls (2.2) s. t. equation of dynamics (2.3). In 

this case we receive a Pareto optimal team solution 
u po {-) = { u po {-), u p p °^, u po {■)) 


where 




r - 


v k iPi j 


0<A(t)<^r p ‘ l 


h; 


0 ,M!)>biELrr\ 

b, 

(2.9) 


A P0 (t) = ce (p - a)(, - T) + e {p - aX '- T) J 

t 

( 2 . 10 ) 


i g N 


ce 


(p-a)(T-r) 


dr 


PO 


(!) 


Optimal cooperative path w has the form (2.7) s. t. (2.9) - (2.10). A 
quantitative characteristic of the system losses from a non-cooperative behavior 
is captured by the price of anarchy [12,13] 

2>r 

PA = ieN 


J 


PO 


( 2 . 11 ) 

Finally, consider a hierarchical setup of the social partnership control 

N _ P Cl 

problem. Suppose that agents from the set 1 ' ’ ’ ' with payoff functional 

(2.1) and constraints (2.2) - (2.3) form a lower control level, and the federal state 
maximizing the summary payoff functional (2.8) forms the upper control level. 
Assume for simplicity that federal state controls are open-loop strategies 

5 ( ) ( s b( )’ s p( )’ s cO) satisfying the conditions 

s(-) eS = {s(t ): 5,(0 > 0, J>,(0 = Ue [0,7]} 

i<=N 

( 2 . 12 ) 

g 

Then there is a hierarchical differential game of type u (Gorelov and 
Kononenko, 2015) with the following information structure. 

1. The leader (federal state) chooses an open-loop strategy (2.12) and reports 

N — P C\ 

it to other players (followers) from set 1 * ’ ’ ’ . 

N = {B P Cl 

2. Given the chosen strategy (2.12), agents from set 1 * ’ ’ ’ play a 

differential game (2.1) - (2.3), the solution of which is Nash equilibrium ^E(s( )) 


3. In fact, the leader chooses a strategy (2.12) which maximizes his payoff 
(2.8) on the set of Nash equilibria ^E( s ( )) _ 
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Let us find a solution of the hierarchical game e $ by simulation modeling 

based on the scenarios method. The proposed algorithm has the following form. 

C = fc ( 1 )(V) c (M) (.)| 

1. Choose a set of scenarios M 1 w ’”’’ WJ , where 

2. Given ^ ^ e ^m calculate ^E(s( )) using formulas (2.4) - (2.5) as well as 
respective path (2.7). 

J ST (c(.\ A®w-)K (.) F c 

3. Calculate the leader’s payoffs ’ > for all M . 

4. Find 

s*(-)sS M :J ST (s*(-),u NE(s * ( '\x m) )= max J ST (s(-),u Nm ,x Nm ) 

s(-)eS M 


1.3. Solution of the power model 

Now suppose that the function of public utility depending on the level of 

professional training has a more general form C ( X W) ~ cx (0 0 < p < 1 

In the case of independent agents, a boundary value problem arises for the 
system of non-linear ordinary differential equations of the following form: 

i 


u- E (t) = \ 


r — 


r hX E (t)^-' 


Kp , 


o < x E (t) < 


KPi 


■r Pi 1 


i J 


0, 

(3.1) 


A? E (t) > 


dA .? 


= -cs iP (x NE y-\tX(t) + (p~ a)X*(t), 


dt 


(3.2) 

A™(T) = Cp(x NE ) p -\T) Si (Ty, 


dx NE 

dt 


NE / ,\ . / NE/.\ NE sr\\ 

= ax (t) + / bfUf ( t ), x (0) = x 0 

ieN 


(3.3) 


In the numerical methods of non-linear boundary value problems solution 
two approaches are differentiated (Dockner et.al., 2000). 

The first one uses an approximate discrete representation of the boundary 
problem connected with determination of a space grid and approximation of the 
unknown functions. The second one is a multiple shooting method where 
"shooting" grid values are the solutions of a system of non-linear equations 
determined by the solutions of a series of Cauchie initial value problems. The 
second method is used to solve the problem (3.1) - (3.3). 
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In the cooperative case all the agents unite, and the optimal solutions for 
optimal power team problem are found from the following boundary value 
problem: 


K u (t) = i 


r — 


'bX 0 (t)' 

V k ‘Pi V 


Pi -1 


, 0<r°(0<— 


0, 

(3-4) 


r u (t)> 


KPi 

b 


.Pi~ 1 


dr 

dt 


-Cp(x PO ) p -\t) + (p-a)A PO (t), A PO (T) = Cp(x P0 ) pl (T) 

(3.5) 


—— = ax PO (t ) + 'Yb i u PO (t ), x PO (0) = x 0 

at ieN 

(3.6) 

The problem (3.4) - (3.6) is once again solved by the multiple shooting method 
(Dockner et al., 2000). 

Finally, let us analyze a hierarchical setup of the problem. The algorithm of 
hierarchical problem study coincides with the one described in the previous 
section; the problem is solved by the scenarios method. The method of transition 
from a differential control model to its precise multistep analogue (Long, 2010) 
based on the following hypothesis is used. 

In any real control system the agents are unable to change their strategies in 
any arbitrary desired moment of time. Their strategies remain constant for a 
certain time period due to objective inertia. Without losing the generality of 
analysis one may suppose that control strategies of all agents are constant at 
equal time periods, i.e. 


w{t) = < 


w 1 , if 0 < t < t ] , 
w 2 , if t l <t<t 2 , 


. w M , if t M _ x <t<T, 

(3.7) 


, w, = const, t=iAf, At=T /M; M 
where ‘ 1 


is a number of intervals of the 


constancy of control variables; 
(B, P, C) or of the leader. 


is a control variable of one of the followers 


In the case when the leader maximizes a total payoff functional similar to 

(2.8), the problem (3.1) - (3.3) takes the following form: 


- the leader's payoff function 
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ivi 

j (( s lk ):,. («»):, )=xx /c - - «/*) a o 




=1 

ieJV 


— e 


-A* 


ieN 


k =1 ieJV 


W 


e p, cx p {t)dt- 


e pr cx p (T) —> max; t k = k£t\At = T/M. 

(3.8) 

- the followers' payoff function 

M T 

j i (( s ik r=i . ( u ik f=i )=Yj ( k (r >k - ^ Y‘ ( e ^ - e ^ k )+ 1 ^ a- {t )cx p (tyit+ 

k =1 0 

e“ p/ .s ; (r)cx: p (r) -> max; / e TV 

(3.9) 

- the control constraints for the follower and the leader, respectively 
0 <u ik <r ik , i e N;k = 1,2,..., Af 

(3.10) 

0 < s ik < 1,^ s ik i e N; k = 1,2,..., M 

isN 

(3.11) 


Here 
the form 


f ik =fi(kAt),ieN;f k 


is a function of time. A dynamics equation has 


dx 

dt 


ax(t) + y>,. (?), x(0) = x 0 

i^N 

(3.12) 


Notice that the multistep-differential model (3.8)— (3.12) is equivalent to 
the differential model (1.1) - (1.3), (2.8) in the following sense. If the set of 

functions ^ ^ ,S ‘ ^ £ j s the equilibrium of the differential model then due 

to the constancy of all control strategies at time periods 


u.(t) = < 


Mil. 


U■ 


i 2’ 


if 0 <t <t x , 
if ^ <t<t 2 , 


u : 


iM ’ 


if 


? M-1 ^ * < T ’ 



if 0 <t<t r , 
if t l <t <t 2 . 


if f M I <t<T. 


( *)M ( 

Then the set ( M,, l'=o ; r" i=o , i eN gives the solution of the problem (3.8) 
- (3.12). In contrast to (1.1) - (1.3), the system (3.8) - (3.12) forms the problem of 
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optimization for functions of many variables (not functionals!) with consideration 
of the hierarchical relations between the control agents. 

Thus, a solution of the problem (1.1) - (1.3) was reduced to the investigation 
of the model (3.8) - (3.12). Notice again that (3.8), (3.9) are objective functions (not 
functionals) depending on 2M variables which are maximized in M variables. 

The following algorithm of solution of the problem (3.8) - (3.12) is proposed. 

1. As a result of parametrical optimization of N functions of 2 M variables 


{ s . f • i 

(M parameters 1 
optimal strategies 


AC 


kL 


) (3.9) s. t. (3.10) in M variables 
depending on the leader's controls, 


the followers' 
i.e. values 


M 


it )t =1 


fcoc)}!!,; i e n 


, are defined. The equation (3.12) is solved analytically 
or numerically by Runge-Kutta method. 

2. The values found at the first stage of the algorithm 

kL k<^)L’ * e N are substituted in (3.8). The values 
which provide maximum (3.8) are optimal for the leader. 




3. Let us cal the set 


(fc£r {«>*)£,) 


an equilibrium in the Stakelberg 


game 

Implementation of the mentioned algorithm by simulation modeling is based 
on the method of direct ordered enumeration with a constant step (14) and 
consists of the following. 

1. Type and values of input functions and the model's parameters are 
assigned. 

{ s . } M -ieN 

2. Current leader's strategy, i.e. the grid function 1 is assigned. 

3. By direct ordered enumeration of the followers' potential reactions to the 
current leader's strategy with a constant step the best followers' replies (grid 

( *( )! M 

functions v > t=l ) are found. These replies provide maximization of objective 
functions (3.9) in the set of enumeration. The differential equation (3.12) is solved 
numerically by a finite differences method or Runge-Kutta method. 

4. If the number of iterations for the leader is not exhausted then a new 
strategy is chosen by a new scenario examination or by perturbation of the current 
strategy. Then go to step 3. 

5. Hence, an approximation to the system equilibrium is determined, i.e. the 

set of values foi". e W ). 


When choosing a new current leader's or a follower's strategy methods of 
direct ordered enumeration with constant or variable step (Basar T. and Zhu Qu, 

2 tjL 

2011) can be used. In this case the interval of uncertainty is equal to K +1, 
where K is a number of points of the partition of feasible controls domain of the 



13064 


L. V. TARASENKO ET AL. dC} 


respective agent, 


a,b 


are boundaries of the domain. The error of determination 


£ = - - — 

of the leader's optimal strategies is K + 1 

Thus, in a finite number of iterations the proposed algorithm of simulation 
modeling permits to build an approximate solution of the model (1.1) — (1.3) or to 
conclude that the equilibrium does not exist. Credibility and efficiency of the 
algorithm follow from the respective properties of the method of direct ordered 
enumeration with a constant step during the simulation calculations. 

1.4. Model calculations 

Let us describe the results of numerical calculations for the linear ^P ^ 

and power (0 < P < 1) mo dels f or gome typical test input data sets with the 
presence of the federal state as a control agent (hierarchical setup) and in its 
absence (independent setup). 

Example 1 (without taking into account the federal state). Assume 

p = 0.1; T = 5 years ; = 175; r ? = 250;r c = 15( >’ k s =K =K = 10; 

Pb~Pp = Pc~ 0.1; b B =b p =b c =1/3 ; a =-0.05;x 0 = 420,c = 2; 


s B = 0.6; s P = s c = 0.2 


. The results for the linear 


0 = 1 ) 


and the power 


are 


(0 < p < 1) m0( j e 2 s are presented in Table 1. In what follows U ‘ ^^ 

the optimal strategies of the players in a cooperative case. 

Example 2 (without taking into account the federal state). For input 


s B = 0.9; s p = s c = 0.05 


the results are given in 


data from the Example 1 and 
Table 2. 

Example 3 (without taking into account the federal state). For input 

s =0 05 ’s =0 05 ’s =09 

data from Example 1 and L B ’ " p ’ c ' the results are given in 

Table 3. 

Example 4 (hierarchical setup). For input data from Example 1 (variables 

s b-> s p-’ S c are desired leader's controls) the results of calculations for the linear 

(P ~ ^ and the power (0 < P < 1 ) models are presented in Table 4. If lower level 
control agents cooperate then the hierarchy does not make sense. 

Example 5 (hierarchical setup). For input data from Example 4 and 
C = 0-003 the numerical results are given in Table 5. 

Example 6 (hierarchical setup). For input data from Example 4 and 
k =k = k =100 

p c b the numerical results are given in Table 6. 
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Table 1. Results of calculations for Example 1 


p 

Jc 

Jp 

Jb 

J 

PA 

1 

1547 

1547 

4548 

7667 

0.997 

0.9 

806 

806 

2314 

3958 

0.992 

0.7 

242 

242 

605 

1127 

0.966 

0.5 

105 

107 

181 

416 

0.966 

0.3 

75 

79 

98 

253 

0.996 

0.1 

68 

71 

75 

215 

0.996 

Table 2. Results of calculations for Example 2 

P 

Jc 

Jp 

Jb 

/ 

PA 

1 

419 

419 

6657 

7667 

0.977 

0.9 

237 

237 

3299 

3958 

0.953 

0.7 

103 

104 

749 

1127 

0.848 

0.5 

74 

78 

235 

416 

0.93 

0.3 

67 

70 

114 

253 

0.992 

0.1 

65 

69 

80 

215 

0.95 

Table 3. Results of calculations for Example 3 

P 

Jc 

Jp 

Jb 

J 

PA 

1 

6657 

419 

419 

7667 

0.977 

0.9 

2297 

237 

237 

3958 

0.70 

0.7 

731 

104 

103 

1127 

0.832 

0.5 

232 

78 

75 

416 

0.925 

0.3 

113 

71 

68 

253 

0.996 

0.1 

79 

69 

66 

215 

0.995 

Table 4. Results of calculations for Example 4 

P 

Jc 


Jp 

Jb 

Jo 

1 

2551 


2551 

2551 

7667 

0.9 

1315 


1315 

1315 

3958 

0.7 

370 


370 

370 

1127 

0.5 

160 


86 

160 

406 

0.3 

89 


73 

90 

252 

0.1 

70 


73 

71 

215 

Table 5. Results of calculations for Example 5 

P 

Jc 


Jp 

Jb 

Jo 

1 

67 


70 

67 

204 

0.9 

66 


69 

66 

201 

0.7 

65 


68 

66 

200 

0.5 

65 


68 

65 

200 

0.3 

65 


68 

65 

199 

0.1 

65 


68 

65 

199 

Table 6. Results of calculations for Example 6 

P 

Jc 


Jp 

Jb 

Jo 

1 

2899 


2899 

2899 

8856 

0.9 

1697 


1697 

1697 

5221 

0.7 

851 


875 

861 

2674 

0.5 

707 


741 

717 

2166 

0.3 

667 


701 

677 

2045 

0.1 

654 


688 

664 

2008 
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The following conclusions can be done based on the conducted calculations: 
In the model setup for a sufficiently representative class of input data the 
interests of agents are well compatible, the price of anarchy is close to one, and 
hierarchical control is not required. 

If lower control level agents cooperate then the leader is not at all required 
due to the input functions of the model. 

If a share in the public good of one player is equal to one then the price of 
anarchy with a growth of power decreases and tends to one when p tends to zero. 

If the shares in public good of all players are approximately equal then the 

price of anarchy is close to one and depending on index of power P varies from 
0.95 to 0.99. 

When the coefficient of transition from a level of professional training to the 
public utility increases, the payoffs of all players also increase. 

When the coefficients increase, it is profitable to the players to extend 
investments in their private activity. 

In contrast, when the coefficient of transition from a level of professional 
training to the public utility increases, it is profitable to make more investments 
in the public good. 

When p increases, the payoffs of all players also increase and obtain the 
maximal value in the case of linear model of transition from a level of professional 
training to the public utility. 

Conclusion 

A differential game theoretic model of the social partnership in the CPE 
system is built. A linear state model and a model with power payoff functions are 
examined. Nash equilibria, team solution, and hierarchical solution for the game 
Git are found. 

Some preliminary conclusions presented above are made on the basis of 
analytical and numerical calculations results analysis. Notice the main idea: in 
this model setup interests of different agents are well compatible, the price of 
anarchy is close to one, and there is no need in additional control levels. A 
transition from a linear state model to the power one does not change the optimal 
strategies, only payoffs change. 

Certainly, the results of analysis of the test examples are quite conventional 
but allows for a qualitative comparison of different methods of organization of the 
social partnership in the CPE system. In future, it is planned to try the proposed 
approach using opinion poll findings. 
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